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APPARATUS AND METHOD FOR 
MICROSCOPIC INSPECTION OF ARTICLES 

This application is continuation of Ser. No. 07/880,100 
filed on Apr, 21, 1992, now U.S. Pat. No. 5,586,058 which 
is a continuation-in-part of Ser, No. 07/801,761 filed on Nov. 
27, 1991 now U.S. Pat. No. 5,619,429, 

HELD OF THE INVENTION 

The present invention relates to apparatus and methods 
for microscopic inspection of articles and more particularly 
to an apparatus and methods for detecting defects in a VLSI 
reticle by comparison to a reference. 

BACKGROUND OF THE INVENTION 

Apparatus and methods for automatically inspecting pho- 
tomasks or reticles used in manufacturing VLSI circuits 
have been described in the literature and have been com- 
mercially available for a number of years. 

These systems generally employ an optical sensor to 
provide an electronic representation of the inspected object 
so that a comparison to another similar object or electronic 
representation can be made. In order to detect non-random, 
i.e. repeating, defects the comparison is generally made 
against a known good reference. If the reference is the 
design database from which the inspected article was 
manufactured, a generally complete set of defect types may 
be detected. An inspection system may be characterized by 
the different types of articles it can inspect, the type of 
reference it uses, the types and sizes of defects it detects, and 
the time it requires to inspect a complete article. Modern 
VLSI technology typically requires the detection of 0.5 
micron defects on a single die Sxreticle in 10 minutes. 

Inspection apparatus is disclosed in U.S. Pat. Nos. 4,247, 
203 and 4,347,001, both to Levy et al. The apparatus 
described in those patents locates faults in the photomask by 
simultaneously comparing adjacent dies on the photomask 
and locating differences. Because a known good die is not 
used in this type of inspection apparatus, only random, i.e. 
non-repeating, faults are generally identifiable, and not 
repeating faults. 

U.S. Pat. No. 4,579,455, also to Levy et al, describes 
attempts to improve the detection efficiency of inspection 
apparatus especially at photomask pattern edges. An area 
subtraction technique is used to identify defects by detecting 
differences between substantially duplicate die patterns in a 
photomask. Two square window matrices of seven rows and 
seven columns of adjacent pixels are defined for correspond- 
ing areas of two die patterns in a single photomask. The 
center 3x3 matrix of each window matrix is defined as a 
comparison matrix with each window matrix having twenty 
five unique subsets of 3x3 adjacent pixels within its boimd- 
aries; one in the center and twenty four others that are offset 
by one or two pixels from the center in one or both 
directions. 

An error value is then calculated for each subset of each 
matrix by summarizing the squares of the differences 
between each of the nine pixel values of each subset and the 
corresponding pixel value of the opposite comparison 
matrix. If there is no defect, and misalignment between the 
two representations is less than two pixels, at least one error 
value will be less than a threshold error value. If none of the 
twenty five error values relating to one comparison matrix 
are less than the threshold value, a defect is assumed to be 
located within the comparison matrix or within the opposite 
window matrix. The magnitude of the threshold error is then 
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automatically varied according to the number of edges 
within the window matrices to compensate for edge induced 
errors. 

U.S. Pat. No. 4,532,650 to Wihl et al describes attempts 
5 to improve the defect efficiency of inspection apparatus 
especially near photomask pattern corners. The detection 
process is based upon using a vector gradient within a matrix 
to develop candidate and canceller information for each 
representation. This information is then logically manipu- 
10 lated to qualify the data obtained and to determine whether 
or not a defect has been detected, 

U.S. Pat. No. 4,805,123 to Specht et al describes a 
photomask and reticle inspection system in which a first 
stream of data representing the image content of a selected 
surface area of an object to be inspected is compared to a 
second stream of data representing the intended image 
content of the selected surface area of the object. After 
misalignment between stored portions of the two streams of 
data is delected and corrected, using shifts of an integral 
number of pixels and/or subpixel interpolation methods, 
subportions are compared in order to detect differences 
therebetween in excess of a predetermined threshold. 

U.S. Pat. No. 4,926,489 to Danielson et al. describes a 
die-to-database reticle inspection system including timing 
control means which is responsive to misalignment between 
the inspected object and the database. The timing control 
means is used to generate control signals which adjust the 
relative output signal rates of the scanner and the database 
thereby maintaining the misalignment below a predeter- 
mined limit. 

SUMMARY OF THE INVENTION 

The present invention seeks to provide an improved 
system for inspection of and detection of defects in objects 
such as reticles, photomasks, semiconductor wafers, flat 
panel displays and other patterned objects. Preferably, the 
system has two or more stages, whereby the object is 
examined separately for fine defects, preferably by inspect- 
ing a binary level representation of the object, and for ultra 
fine defects, preferably by inspecting a gray level represen- 
tation of the object. 

The two-stage inspection system has the advantage of 
allowing different algorithms to be used for fine defect 
45 detection and for ultra fine defect detection, each algorithm 
being generally optimal for defects of the size it is intended 
for but not necessarily for defects of other sizes. The system 
may make die to database comparisons or die to die com- 
parisons. 

50 The system also preferably includes reinspection appara- 
ms for reinspection of detected defects, thereby to reduce the 
false alarm rate, and for classifying the remaining defects by 
size, area and type. Preferably the system also includes 
diagnostic apparatus for performing diagnostic functions 

55 such as inspecting the flow of information through the 
system and diagnosing which component of the system may 
be misoperating. 

There is thus provided in accordance with a preferred 
embodiment of the present invention an inspection method 

60 including the steps of providing a patterned object to be 
inspected and compared with a reference, inspecting the 
patterned object and providing an output of information 
relating to the visual characteristics of the patterned object, 
comparing binary level information relating to the visual 

65 characteristics of the patterned object to binary level infor- 
mation relating to the visual characteristics of the reference, 
and comparing gray level information relating to the visual 
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characteristics of the patterned object to gray level info rma- There is also provided in accordance with a further 

tion relating to the visual characteristics of the reference. preferred embodiment of the present invention an inspection 

^re is also provided in accordance with a further method including the steps of providing a patterned object to 
preferred embodiment of the present invention an inspection inspected and compared with a reference, inspecting the 

method including the steps of providing a patterned object to 5 patterned object and providing an output of information 

be inspected and compared with a reference, inspecting the ^^^^^.^S characteristics of the patterned object 

patterned object and providing an output of information Praviding an mdication of differences between the patt^ 

relating to the visual characteristics of the patterned object, ^^h'" ' 't ' 'T'f 'i . ^^'^^^''^^^y ^^f^^^^^^' ^ 

. .J- * • J- f j £c i_ second inspection of at least some areas of the patterned 

and providmg an output indication of differences between object thereby to complement the providing step by enhanc 
the patterned object and the reference the step of provid^^ 10 ^ indication of differences provided by the 

includmg the steps of sensmg hill profiles and valley profiles providing step 

in information relating to the visual characteristics of the ^h^^ f^;^^^ p^^^y^j ^ accordance with still a further 

patterned object, sensmg hiU prolUes and vaUey proHles in preferred embodiment of the present invention an inspection 

information relatmg to the visual characteristics of the system including apparatus for comparing an inspected 
reference and providing a defect indication when a hill 35 object to a reference and providing an output of information 

profile or a valley profile of at least a sufficient level is relating to the visual characteristics of the inspected object, 

sensed for a given location in the patterned object and not for binary level comparison apparatus for comparing binary 

a corresponding location in the reference. level information relating to the visual characteristics of the 

There is also provided in accordance with a preferred inspected object to binary level information relating to the 

embodiment of the present invention an inspection method visual characteristics of the reference, and gray level com- 

for providing an output indication of differences between an parison apparatus for comparing gray level information 

patterned object and a reference and including the steps of relating to the visual characteristics of the inspected object 

providing a patterned object to be inspected and compared to gray level information relating to the visual characteristics 

with a reference, comparing binary level information relat- of the reference. 

ing to the visual characteristics of the patterned object to ^5 Further in accordance with a preferred embodiment of the 

binary level information relating to the visual characteristics present invention, the system also includes apparatus for 

of the reference and filtering out differences within a providing information relating to the visual characteristics of 

selected magnitude range. the reference. 

There is further provided in accordance with yet a further Still further in accordance with a preferred embodiment of 

preferred embodiment of the present invention an inspection the present invention, the gray level comparison apparatus 

method including the steps of providing a patterned object to includes apparatus for converting binary level information 

be inspected and compared with a reference, initially relating to visual characteristics of the reference into gray 

inspecting the patterned object and providing an output of level information. 

information relating to visual characteristics of the patterned Additionally in accordance with a preferred embodiment 

object, providing an output indication of differences of the present invention, the binary level comparison appa- 

between the patterned object and the reference representing ratus is operative to sense differences of at least a first 

possible defects, and simultaneously storing information minimum size and the gray level comparison apparatus is 

regarding visual characteristics of areas of the patterned operative to sense differences of at least a second minimum 

object at which possible defects are indicated. size smaller than the first minimum size. 

Further in accordance with a preferred embodiment of the Still further in accordance with a preferred embodiment of 

present invention, the method also includes the step of the present invention, the gray level comparison apparatus 

automatically carrying out a fiirther inspection of the areas includes first apparatus for sensing hill profiles and valley 

of the patterned object using the stored information. profiles in the information relating to the visual character- 
Still further in accordance with a preferred embodiment of 45 istics of the inspected object, second apparatus for sensing 

the present invention, the step of automatically carrying out hill profiles and valley profiles in the information relating to 

includes the step of comparing at least some of the areas to the visual characteristics of the reference, and apparatus for 

a reference. providing a defect indication when a hill profile or a valley 

Additionally in accordance with a preferred embodiment profile of at least a sufficient level is sensed for a given 
of the present invention, the method also includes the step of 50 location in the inspected object and not for a corresponding 

displaying the stored information to an operator. location in the reference. 

In accordance with still a further preferred embodiment of Further in accordance with a preferred embodiment of the 

the present invention there is provided an inspection method present invention, the system also includes apparatus 

including the steps of providing a patterned object to be responsive to selected information indicating the presence of 
inspected and compared with a reference, inspecting the 55 selected features at locatioas in the reference for preventing 

patterned object and providing a representation of visual provision of an output indication of difference in respect of 

characteristics of the patterned object, providing an output Ihosc locations. 

indication of differences between the patterned object and a Still further in accordance with a preferred embodiment of 

representation of visual characteristics of the reference, at the present invention, the location in an individual one of the 
least one of the inspecting step and the difference indicating 60 reference and the inspected object is larger in area than the 

step including the step of providing at least one subsystem corresponding location in the other one of the reference and 

which modifies at least one of the representations, thereby to the inspected object. 

provide a plurality of representations of at least one of the Additionally in accordance with a preferred embodiment 

patterned object and the reference, and inspecting the flow of the present invention, the second apparatus for sensing is 
of information through the inspecting apparatus and the 65 operative with a higher sensitivity than the sensitivity of the 

difference indicating apparatus and including comparing first apparatus, thereby to reduce the false alarm rate of the 

individual ones from among the plurality of representations. apparatus for providing a defect indication. 
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There is also provided in accordance with yet a further inspection is characterized in that the second inspection of 

preferred embodiment of the present invention an inspection areas of an inspected object may be initiated while the 

system for providing an output indication of dififerences apparatus for providing an output indication is operating, 

between an inspected object and a reference and including Further in accordance with a preferred embodiment of the 
binary level comparison apparatus for comparing binary 5 present invention, the apparatus for carrying out a second 

level information relating to the visual characteristics of the inspection is characterized in that the second inspection of 

inspected object to binary level information relating to the areas of an inspected object may be initiated while the 

visual characteristics of the reference, and apparatus for apparatus for providing an output indication is operating on 

providing an output indication of dififerences and including inspected object. 

apparatus for filtering out differences within a selected lO '^^^e is also provided in accordance with a further 

magnitude range. preferred embodiment of the present invention an inspection 

• . r J L J- * r.u system including inspecting apparatus for inspecting an 

Further in accordance with a preferred embodiment of the ^ object and providing a representation of vdsual 

present invenUon, the binary companson apparaU^ indudes characteristics of the inspected object, difference indicating 

at least one of the foUowing: at least one SUBTRACTION apparatus for providing an output indication of differences 
logical operator, and at least one XOR logical operator. « ^gtween the inspected object and a representation of visual 

Still further in accordance with a preferred embodiment of characteristics of a reference, at least one of the inspecting 

the present invention, the apparatus for filtering includes an apparatus and the difference indicating apparatus defining at 

EROSION operator and/or an ACCEPTANCE operator. least one subsystem which modifies at least one of the 

Additionally in accordance with a preferred embodiment representations, thereby to provide a plurality of represen- 

of the present invention, the apparatus for filtering includes '° °^ ^' '"^j "?SP^'^? °^i^<=^ 

apparatus for differentiating between differences between reference, and mfonnation flow inspection apparatus for 

the inspected object and the reference on the basis of the ""specting the flow of mformation through the inspecUng 

location of each difference relative to at least one edge of an apparatus and the difference indicating apparatus and includ- 
adjacent binary shape defined in at least one of the inspected „ "JS apparatus for companng wdividual ones from among a 

object and the reference. P'"f»'"y °^ representauons of an object. 

,v ' A ^ -iU * A Further in accordance with a preferred embodiment of the 

There is also provided in accordance with yet a further . . • ^ r, 

f J u -a* * i?*u *• *■ • *• present mvention, the mformation flow inspection apparatus 

preferred embodiment of the present invention an mspection • i . ' c j- • . j* .i * i . j 

, • 1 J- * r • 11 - mcludes apparatus for providing mput directly to a selected 

system including apparatus for initially inspecting an r *u * i * u * 

• * A u * I -J- * * f-c 4- one of the at least one subsystems, 

mspected object and providmg an output of information 30 „ .„ ^ . . , - , ^ , . 

relating to visual characteristics of the inspected object and , ^tdl further m accordance with a preferred embodiment of 

apparatus for providing an output indication of differences P-j^^f invention, the input includes a representation of 

between the inspected object and a reference, representing "f^^ characteristics of one of the mspected object and 

possible defects, and for simultaneously storing information ""'P"'* » subsystem upstream of the selected 
regarding visual characteristics of areas of the inspected 35 s^^syst^rn- 

object at which possible defects are indicated. Farther in accordance with a preferred embodiment of the 

Furtherina<xordancewithapreferredembodimentof the P^sent invention, the input includes a test pattern, 

present invention, the system also includes further inspec- , Still further m accordance with a preferred embodiment of 

tion apparatus for automatically carrying out a further P^^^^^^ invention, the mformation flow mspection appa- 
inspcction of the areas of the inspected object using the 40 '^^"^ includes apparatus for inspecting the output of a 

stored information. selected one of the at least one subsystems. 

Still further in accordance with a preferred embodiment of Additionally in accordance with a preferred embodiment 

the present invention, the apparatus for automatically car- the present mvention, the system includes apparatus for 

ryiag out includes apparatus for comparing at least some of P«>vidmg a representation of mformation relatmg to visual 
the areas to a reference. 45 characteristics of a selected object to a selected one of the at 

. , f J u J- * least one subsystems, thereby to provide a plurality of 

Additionally m accordance with a preferred embodiment ^ i^^i^J^f information related to visual characteris- 

of the present invention the system also mcludes apparatus ^^^^ ^^^^^^^^ ^^^.^ 

for displaying the stored information to an operator. ^ . , - , , . , r , 

^ ^ . . , . , ^ . . r There is also provided in accordance with still a further 

still further m accordance with a preferred embodiment of j^^^j embodiment of the present invention an inspection 

the present invention, the system also mcludes apparatus for ^ j^^j^^jj^ apparatus for comparing an inspected 

providmg mformation relatmg to the visual characteristics of ^j,^^^, j„ ^ j^^^^^ p^^^j^j^^ „^,p„j information 

e re erence. relating to the visual characteristics of the inspected object. 

Further in accordance with a preferred embodiment of the fif^t apparatus for providing an indication of differences 

present invention, the apparatus for storing is operative to between the inspected object and the reference, and second 

store the information provided by the apparatus for initially apparams for automatically carrying out a second inspection 

inspecting. ^1 j^^j ^^.^^ inspected object and for 

Still further in accordance with a preferred embodiment of complementing the first apparams and including apparatus 

the present invention, the apparatus for storing is operative for enhancing the output indication of differences provided 

to store an output indication of differences received from the by the first apparatus. 

apparatus for providing an output indication of differences. Further in accordance with a preferred embodiment of the 

Additionally in accordance with a preferred embodiment present invention, the apparatus for enhancing includes 

of the present invention, the further inspection apparatus apparatus for preventing provision of the output indication 

includes apparatus for classifying at least some of the of difference in at least some areas of the inspected object, 
possible defects in accordance with at least one criterion. 55 thereby to reduce the false alarm rate of the first apparatus. 

Still further in accordance with a preferred embodiment of Still further in accordance with a preferred embodiment of 

the present invention, the apparatus for carrying out a second the present invention, the second apparatus includes appa- 
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ratus for providing an output indication of differences plurality of subsystems being operative to receive a first 
between the inspected object and the reference not detected representation of information to be processed and to output 
by the first apparatus, a second representation of the information to be processed, 
There is further provided in accordance with still another apparatus including information flow diagnosing appa- 
preferred embodiment of the present invention alignment s rams for comparing individual ones from among the plural- 
apparatus including apparatus for providing binary level representations. 

information relating to a patterned object to be inspected, Still further in accordance with a preferred embodiment of 

thereby to define an inspected object channel, apparatus for the present invention, the information flow diagnosing appa- 

providing binary level information relating to a reference, ratus is synchronized with the information processing sys- 
thereby to define a reference channel, and apparatus for ^0 tem. 

aligning the inspected object channel and the reference Additionally in accordance with a preferred embodiment 

channel using the binary level information. of the present invention, the information flow diagnosing 

Further in accordance with a preferred embodiment of the apparams is electronically integrated with the information 

present invention, the apparatus for aligning includes first processing system. 

apparatus for comparing a portion of the binary level infor- Further in accordance with a preferred embodiment of the 

mation relating to the inspected object to a corresponding present invention, the information flow diagnosing appara- 

portion of the binary level information relating to the ms includes apparatus for comparing individual ones from 

reference, thereby to provide an output indication of among the plurality of representations in real time, 

misalignment, and second apparatus for receiving the output Further in accordance with a preferred embodiment of the 

indication of misalignment firom the first apparatus and for present invention, the apparatus also includes apparatus for 

aligning the corresponding portions of the binary level providing input, such as a test pattern, directly to a selected 

information relating to the inspected object and the refer- one of the at least one subsystems. 

Still further in accordance with a preferred embodiment of 
Further in accordance with a preferred embodiment of the ^5 the present invention, the apparatus also includes apparatus 

present invention, the system also includes apparatus for for receiving the output of a selected one of the at least one 

receiving information relating to the visual characteristics of subsystems. 

the reference from a database precursor of the reference. Additionally in accordance with a preferred embodiment 

Still further in accordance with a preferred embodiment of of the present invention, the apparattis for receiving includes 
the present invention, the apparatus for inspecting includes 30 apparatus for recording the output of the selected one of the 

apparatus for inspecting the reference and providing infor- least one subsystems and apparatus for off-line processing of 

mation relating to the visual characteristics of the reference, the recorded output. 

Additionally in accordance with a preferred embodiment BRIEF DESCRIPTION OF THE DRAWINGS 
of the present invention, the system also includes apparatus 

for inspecting the reference and providing information relat- 35 P^sent invention will be understood and appreciated 

ing to the visual characteristics of the reference. the following detailed descripUon, taken m conjunction 

Still further in accordance with a preferred embodiment of with the drawings in w ic . 

the present invention, the apparatus for inspecting includes F^G. 1 is a generahzed block diagram of apparatus 

apparatus for varying the magnification at which at least the constructed and operative m accordance with a preferred 

inspected object is inspected. embodmient of the present mvention; 

Further in accordance with a preferred embodiment of the FJ^S^ 2A-2F are conceptual iUustratioris of stages of a 

. . * r • 1 • 1 J preferred algorithm for the binary defect detector 32 of FIG. 

present invention, the apparatus for mspecting also includes 1 . 

apparatus for automatically controlling, as a function of the ' , . ^ ^ . . . , , , 

magnification, parameters relating to the inspection of at FIG. 3A illustrates a 5x5 pixel neighborhood; 

least the inspected object. F^GS. 3B-3C are conceptual illustrations of a binary 

Further in accordance with a preferred embodiment of the f^^' '"'^ '° ^^"^ "^'^''^ 

present invention, the patterned object includes an indi- ' \. ^ ■ ^, 

vidual one of the following group: a flat panel display, a F^GS. 4A-4I are concepUial illustrations of a noise fil- 
reticle, a printed circuit board, a semiconductor wafer, a „ ^^^^^ method useful m conjunction with the bmary defect 

photomask, and a blank of any of the above. detector 32 of FIG. 1; 

w , -.u 4 r *u r J u J* * r FIG. 5 is a block diagram of the ultra fine level defect 

In accordance with still a further prefenred embodiment of ^ , *t 64 f Fir 1 • 

the present invention, there is provided an inspection system 1!"' ° ' ' 

including apparatus for providing at least one representation FI^S. 6A-^L are conceptual illustrations of types of 

of the visual characteristics of an inspected object, first 55 ^^f^^. ^^^^ f g operators used in a preferred 

apparatus for comparing an individual one of the at least one embodiment of the ultra fine level defect detection unit 64 of 

representations of the inspected object to a reference and for ^IG. 1; 

providing an output indication of differences, and second F^G. 7 is a block diagram of smoothing unit 100, defect 

apparams for comparing an individual one of the at least one detectors 102 and 104 and defect comparison unit 106 of 

representations to a reference, thereby to complement the F^*^- 

first apparatus by enhancing the indication of differences FIGS. HASH are block diagrams of the defect detection 

provided by the first apparatus. units 118-125 of FIG, 7; 

According to still a further preferred embodiment of the FIG- is a block diagram of convolver 116 of HG. 7; 

present invention, there is provided diagnostics apparahis FIG. 10 is an illustration of the coordinates of a window 
for diagnosing the operation of an information processing 65 used by convolver 116 of FIG. 7; 

system, the information processing system including a plu- FIG. 11 is a block diagram of channel handler 140 of FIG. 

rality of subsystems, each individual one from among the 7; 
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FIG. 12 is a block diagram of the real lime defect seniation received by the biDarization unit 30. The pixels of 

recording unit 66 of FIG. 1; the 8 bit gray representation of the object to be inspected 

FIG. 13 is a block diagram of the postprocessor 67 of FIG. which are received by binarization unit 30 are termed herein 

1; big pixels (BP) or large pixels (LP). The pixels of the binary 

HG. 14 is a combined block diagram and schematic from ^ representation of the object to be inspected which are 

view of scanner 10 of FIG. 1; and provided by binarization unit 30 are termed herein small 

FIG. 15 is an exploded view of the optical components of ^^^^ ^. , . - . . . . 

the scanner 10 of FIG !• output of bmanzation unit 30 is received by a binary 

' defect detector 32 via an image delay compensator 34. The 

DETAILED DESCRIPTION OF PREFERRED lo compensator 34 is operative to delay the output of binariza- 

EMBODIMENTS tion unit 30 by a fixed time interval of typically 5x10""* sec. 

^ - . w-wr^ ^ 1 • 1 ■ 1 so that each portion of output, representing the inspected 

Reference is now made to FIG. 1 whjch is a conceptual ^^j^^^ ^ ^^^^^ ^^^^^^^ 32 ^^ ^^^^ 

block diagram of an inspection system 6 co^tructed and corresponding portion of the information 

operative in accordance with a preferred embodiment of the ^g,^^^ ,^ reference. Tho information relating to the 

present mvenUon. TTie inspection system 6 is controlled by ^^j^^^^^ ^^j^^^ ^ j^j^j ^^^^^^^ 32 f^^^ 

a main controUer 8 and generally comprises means for ^^^^^^^ aUgnment memory 59 as explained in more detail 

scanning an inspected object, denning an inspected channel, below 

and means for providing a reference such as a reference die ^. ^^j^^, 33 ^ g„g j.^^, detector 

or a database, defining a reference channel. Inspection and is operative to detect, in the inspected object, defects of 

system 6 also generally comprises means for abgning the ^ ^^1^^,^^ minimum size, typically 0,7-1.4 pixels. Binary 

inspected and reference channels means or comparmg the ^j^^^, 33 ,,30 ^e opera itive to detect certain 

mspected and reference channels in order to provide an ^^^j, ^ ^ j,^,^^ 

output indication of defects m the inspected object, and. ^^^^^ somewhat smaller than the selected minimum 

preferably, means for diagnosing the function of the system. ^.^^ 

The real time means for comparing the two channels is ^ database preprocessing station 36 stores or otherwise 

preferably operative on two levels, termed hereinbelow provides information regarding a database to which the 

"fine" defect detection and "ultra-fine" defect detection, and object undergoing inspection may be compared, if a die to 

is also preferably operative to record information regarding database process is employed. Alternatively, the inspected 

defects detected in real time, thereby to enable subsequent 30 object may be compared using a die to die process, as 

re-examination of these defects in order to reduce the false explained in more detail hereinbelow. Preprocessing station 

alami rate of the defect detection process. Re-examination of 35 typically converts the database, which may be in a 

the defects is preferably not executed in real time. Once vectorial or polygonal format such as MEBES or GDSII and 

detected, defects may be categorized and/or repaired. More have a relatively high resolution, to an intemal format, 

specifically, the inspection system 6 preferably includes the 35 The converted database information is then provided, via a 

following components: local area network (LAN), to the main controller 8. Con- 

A scanner 10 is operative to electro-optically scan an troller 8 passes on the newly formatted information via 

object to be inspected and to output a gray-level digital vector commands to a database rasterizer 38 which provides 

representation thereof, preferably of 8 bit depth. A repre- a binary level raster representation of the database. The 

sentalion of a scanned portion of the object is preferably 40 pixels of the binary level database provided by rasterizer 38 

arranged as a two dimensional array having n lines and m are termed herein small pixels (SP). 

pixels per line. A typical number of pixels per line is 1024. Alternatively, a reference other than a database may be 

The scanner 10 preferably scans successive, equally dis- employed. For example, if the object to be inspected com- 

tanced lines. The time required to scan a single line is termed prises a plurality of identical areas, a die to die type 

herein a "line time". The "line time" may not be a constant 45 procedure may be employed in which a first such identical 

but rather may vary linearly as a function of the instanta- area may be compared to each of the other identical areas 

neous scanner velocity. The scanner 10 is described in detail and may serve as a reference therefor. Preferably, a portion 

hereinbelow with reference to FIGS. 14 and 15. of gray level information regarding the reference die is read 

The scanner 10 provides an output indication of timing to by the scanner 10 and stored in a reference die memory 43, 

all relevant components of the system, as shown, via a 50 Tht stored information is binarized by a binarization unit 44 

timing controller 22 which is operative to synchronize the which may be similar to binarization unit 30. The corre- 

various components of the system in accordance with the sponding portion of information regarding the inspected die 

timing of the scanner 10. The scanner timing output indi- is then read by the scanner, binarized by binarization unit 30 

cation typically comprises the following three signals: and compared with the output of binarization unit 44. 

a. A "start of scan" signal indicative of the time at which 55 Preferably, all scanned reference die information is retained 
scan of the inspected object is initiated; in reference die memory 43 and is not discarded, in order to 

b. A "grab line" signal indicative of the time at which scan allow postprocessing of detected defects without rescanning 
of the current line is initiated; and the reference die, as explained in more detail hereinbelow 

c. A "grab pixel" signal indicative of the time at which scan with reference to FIG. 13. 

of the current pixel is initiated. 60 Preferably a switch 45 is provided for selecting whether 

The 8-bit scanner output is binarized by a binarization the reference information provided to misalignment detec- 

unit 30 such as the binarization system shown and described tion memory 58 (see below) originates from a database, as 

in Applicants' copending U.S. Pat. No. 5,774,572, the dis- in die to database comparison methods, or from a die, as in 

closure of which is incorporated herein by reference. As die to die comparison methods. 

explained in that document, the output of the binarization 65 The binary database information or binarized reference 
unit 30 is a binary digital representation of the object to be information selected by switch 45 is provided to an auto- 
inspected at a higher resolution than the gray digital repre- matic registration subsystem comprising a misalignment 
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detection memory 58, a database alignment memory 59, a carried out in conjunction with a feature detector which is 

die alignment memory 60 and a misalignment computer 61. operative to detect features, such as edges which are 

The automatic registration subsystem is operative to align or non-parallel to the axes and corners, which may require 

provide registration between the reference channel and the special treatment. 

inspected object channel The automatic registration sub- 5 2. Global displacement computation: Quantification of the 

system is operative to correct for continuous misregistration global displacement along two orthogonally disposed 

phenomena, such as irregular velocity of the scanner, system axes, in a large "global" window around the current hne, 

vibrations and thermal drift and also for misregistration due typically comprising approximately 12 lines, using the 

to discontinuities in the inspected channel such as stepping local measurements derived from each of the plurality of 

errors or sparse geometries. lo "local" windows contained within the "global" window. 

In the forgoing discussion of the automatic registration A preferred method for carrying out the first, local step is 

subsystem, the term "line" is intended to refer to an indi- *s follows: 

vidual sequence of pixels, typically comprising 1024 pixels. The binary representation of the image is typicaUy pro- 
output by the CCD array of the scanner 10 during a single vided at the same resolution as the database resolution, 
"line time". 15 which may be effected within binarizalion unit 30, as 
The binary database information and the binarized scan- explained in detail in Applicant's copending U.S. applica- 
ner output representing the inspected object enter the auto- tion Ser No. 684,583. The local displacement of the image 
matic registration computer 61. This unit together with the ^ with respect to the database D may be computed by 
misalignment detection memory 58 operate in a servo type performing subtractions I-D and D-I, as illustrated in the 
manner to compute the misregistration between the refer- 20 example below, and subsequently determining the lengths of 
ence channel and the inspected channel. Registration cor- ^^e runs in the streams I-D and D-I. It should be noted that 
rection commands are subsequently applied to the contents the length may be positive or negative depending on the 
of database alignment memory 59 and of die alignment relative position of the image with respect to the database, 
memory 60, thereby to provide aligned representations of Preferably, not every row of binary pixels, but rather only 
the database and the die respectively. The registration cor- 25 row from among each few adjacent binary pixel rows of 
rection commands are operative to determine the addresses streams I-D and D-I, is sampled, along each of the 
according to which information should be read from the plurality of axes. 

alignment memories 59 and 60. A sample computation of local displacement in a window 
The provision of two separate memory arrays, the first which, for purposes of illustration, is seen to contain only 
memory array comprising misalignment detection memory 30 ^^^^ pixels, is as follows: 
58 and the second memory array comprising alignment 
memories 59 and 60, has the advantage of giving the 
automatic registration subsystem a look-ahead capability. 
Specifically, each individual portion of the reference data 
stream arrives at the registration computer 61 and substan- 
tially simultaneously is stored at alignment memories 59 and 
60. The "delay" introduced by alignment memories 59 and 
60 allows registration computer 61 to issue suitable regis- 
tration commands to the alignment memories 59 and 60, The two matrices respectively represent portions of three 
thereby to align the individual portion of the reference data 40 corresponding binary pixel rows of the inspected object I 
stream before it reaches defect detectors 32 and 64 (see and of the reference or database D. The sampled or current 
below). This look ahead capability allows the system to row is the middle row. 

recover more rapidly from misalignments which develop (I-D) in the x direction is: 0110000011110 

during discontinuities in the inspected data stream such as There are two runs, of length 2 and 4 respectively, 

stepping errors or sparse geometries, by looking ahead to a 45 (D-I) in the x direction is: 0000111100000 

patterned non-blank area. There is one run, of length 4. 

The purpose of automatic registration is to achieve a Analogous computations may be carried out along other 

global match between a binary representation of the image axes, such as the y axis. 

and the database, on-the-fly, based on some neighborhood Preferably, a filtering operation is performed on the length 

around the currently scanned data. A registration vector is 50 values of the detected runs, and thereby some of the length 

computed for each line of scanned image pixels representing values are filtered out. The remaining length values are 

the displacement to be applied to the database pixels so as termed herein "valid". 

to correctly align them with respect lo the corresponding The filtering process is preferably based on the following 

scanned image pixels. principles: 

A preferred binary alignment method, in which local 55 First, a threshold value is defined which determines the 

measurements of displacement are used to compute a global largest expected run length value. Run length values exceed- 

measurement of displacement, comprises the following two ing this threshold are filtered out. 

steps: Second, a feature detector is provided that detects "prob- 

1. Local displacement measurement: Quantification of the lem zones" containing problematic features such as edges 

local displacement along a plurality of axes, preferably 60 which are non-parallel to the axes and comers. Run length 

two orthogonaDy disposed axes, in a small "local" win- values overlapping such problem zones, even partially, are 

dow around the current line of the scanned image. Any filtered out. 

suitable method may be employed to identify and quantify Preferably, the feature detector is operative to inspect 

the local displacement, such as use of XOR operators and pixels along the edges of binary shapes in the reference data 

subsequent counting of the length of the XOR operator 65 and to mark the problematic features. This may be carried 

along each of the axes. A preferred size for the window is out by considering the two slopes respectively joining each 

approximately 5-10 lines. The measurement is preferably edge pixel to two adjacent pixels along the edge. If the two 
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slopes are nonequal, then a corner is identified. Also, the Referring again to FIG. 1, fine defect detector 32 receives 

value of the slopes separately and in combination indicates the aligned binary representation of the reference from 

the orientation of the edge relative to the axes. The two database alignment memory 59, compares it to the binary 

adjacent pixels used for slope computations may be the two output of binarization unit 30, which represents the object to 

pixels directly adjacent to the current edge pixel or may 5 be inspected, and provides an output indication of fine 

alternatively be separated from the current edge pixel by one defects to a defect processing unit 62. 

or two pixels. An ultra fine level defect detector 64, referred to herein- 

These operations may be implemented by creating a LUT below as the "MIC" or microscopic unit, is operative to 

which stores most or all possible configurations of a kxk detect defects of a size below the minimum size defect 

vicinity of a current pixel, where typical values for k are lO detectable by fine level defect detector 32. Ultra fine defect 

approximately 3 to 5. The LUT labels each such configu- detector 64 preferably somewhat overlaps fine defect detec- 

ration as "corner", "diagonal", i.e. non-parallel to the axes, tor 32 in range, in that it also is capable of detecting defects 

or "parallel", i.e. parallel to the axes. Preferably, the "par- of a size somewhat above the minimum defect size defined 

allel" label is provided with an indication of the axis to by fine level detector 32. Preferably, the defect detector 64 

which the configuration is parallel. "Comer" and "diagonal" is is operative to detect defects of size approximately 0.5-1.5 

labels are both referred to herein as "invalid" labels. A pixels. 

"parallel" label is referred to herein as an "invalid" label. Preferably, the fine level defect detector 32 is operative to 

Preferably, when a particular configuration is marked as receive and compare binary representations of the reference 

invalid, the invalid mark is applied not only to the current and inspected object, whereas the ultra fine level defect 

pixel but is also propagated to a neighborhood, which may 20 detector 64 is operative to receive and compare gray-level 

be approximately 12 fines in size, of the current pixel. This representations of the reference and inspected objects. Ultra 

is done in order to compensate for misalignment between the fine level defect detector 64 receives the aUgned represen- 

reference and scanned (inspected) channels. lation of the reference via a switch 65 which is operative to 

A preferred method for computing slopes and corner select whether the reference information originates from a 

angles is described in Digital Picture Processing by A. 25 database, as in die to database comparison methods, or from 

Rosenfeld and A. Kak, Academic Press, 1982, Vol. 1, pp. a die, as in die to die comparison methods. In the first 

257 onward, the disclosure of which is incorporated herein instance, the aligned representation of the reference database 

by reference. is received by detector 64 from database alignment memory 

A third principle of the filtering process is that a threshold 59. In the second instance, the aligned representation of the 

value is defined which determines the largest expected mean 30 reference die is received by detector 64 from die alignment 

run length value in a local window. If the mean run length memory 60. 

value in a particular local window exceeds this threshold Ultra fine level defect detector 64 upgrades the aligned 

value, all run length values in that local window are filtered representation, if binary, as in the case of a die to database 

out. This threshold value may not be constant. Preferably, process, to a gray- level representation. Fine level defect 

the threshold value is an increasing function of the number 35 detector 64 conapares the gray-level representation of the 

of lines preceding the present line yielding no valid run reference to the gray-level representation of the inspected 

lengths, such as blank lines. object provided by the scanner 10, and provides an output 

The output of the local displacement measurement step indication of ultra fine level defects to defect processing unit 

for each local window is preferably: 62. 

(a) the number of valid runs; and 40 Preferably, the defect processing unit 62 is operative to 

(b) the algebraic sum of the lengths of the runs. compare information from the detectors 32 and 64, such that 
A preferred method for carrying out the second, global if a defect, such as a defect the size of a single pixel, is 

step of the binary alignment method is by computing a identified by both detectors, the "double indication" of this 

global registration vector as follows: defect is appropriately combined into a single indication. 

a. For each global window, the mean run length, for all valid 45 In the shown embodiment, defect processing unit 62 
runs in that global window, is computed. receives defect indications from two detectors, fine detector 

b. The sequence of mean run lengths for a sequence of global 32 and ultra fine detector 64. However, it is appreciated that 
windows is preferably smoothed using a conventional the defect processing unit may receive defect indications 
smoothing function. from any suitable number and type of detectors, if multiple 
The width of a global window is preferably at least half so level detection, rather than two level detection, is desired. 

of the scan width and its length may be a few dozen lines. Preferably, defect processing unit 62 interfaces with a real 

'The smoothing function may comprise any suitable func- time recording unit 66 which is operative to record in real 

tion such as either of the following: time an image of each putative defect identified by defect 

1. A threshold function for limiting the frequency and detectors 32 and 64. Subsequently, software implemented 
amplitude of displacement vector fluctuations as a func- 55 defect analyzing algorithms are employed in a postprocess- 
tionof the number ofvalid run length measurements. This ing unit 67 in order to reduce the false alarm rate of the 
threshold value may not be constant. Preferably, the defect detection process. Since only a relatively small num- 
threshold value is an increasing function of the number of ber of locations within the representation of the inspected 
lines preceding the present line which yielded no valid run object (those identified as putative defects) need be 
lengths, such as blank lines. 60 analyzed, the analysis carried out by postprocessing unit 67 

2. An adaptive filter such as an LMS filter may be used to need not be in real time, thereby enabling more sophisticated 
monitor periodic fluctuations in the displacement vector. post-processing analysis. Postprocessing unit 67 is described 
This method may be used to partiaUy overcome the in more detail hereinbelow with reference to FIG. 13. 
problem of blank lines in which little or no valid infor- The defect processor 62 is operative to transform each 
mation is available. 65 received defect indication from defect detection units 32 and 
In the preceding discussion, the terms "registration" and 64 into a trigger signal and a defect coordinate signal which 

"displacement" have been used generally interchangeably. are provided to defect recorder 66 over channels 68 and 70 
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respectively. The trigger signal is indicative of the corapo- It is a particular feature of the embodiment of FIG. 1 that 

nent (either fine level unit 32 or ultra fine level unit 64) the inspection system provides synergism between first 

which identified the defect. The defect coordinate signal apparatus for providing a first output indication of differ- 

provides an indication of the location of the defect, prefer- enccs between the inspected object and the reference and 

ably comprising an indication of the line/s and pixel/s within 5 second apparatus for automatically carrying out a second 

the line/s at which the defect occurs. inspection of at least some areas of the inspected object. 

According to a preferred embodiment of the present thereby to complement the first apparatus by completing 
invention, real time recorder 66 interfaces with the output said partial output indication of differences provided by said 
busses of substantially all of the system components via an first apparatus. This synergism is provided at least between 
image bus 72, thereby to allow real time recording of the 30 the binary defect detector 32 and the gray defect detector 64, 
flow of information throughout the entire system. The real and also between the initial processing unit, comprising both 
time recordings of the output images and indications pro- detectors 32 and 64, and the post-processing unit 67 (see 
vided by the various system components are provided to a FIG. 13) associated with real time defect recorder 66. 
diagnostics memory and processor 76 which is operative to The advantage of providing two-part synergistic inspec- 
monitor and diagnose flaws in the operations of the various 15 tion of the object, or, more generally, of providing an 
components of inspection system 6. According to a preferred inspection system having a synergistic plurality of mutually 
embodiment of the present invention, the diagnostics complementing inspection subsystems, as opposed to pro- 
memory and processor 76 interfaces with a test bus 78 which viding a single inspection system, is that each subsystem of 
inputs to all components of inspection system 6, thereby to the inspection system may be optimized for a particular 
allow test images or random patterns to be injected into any 20 requirement of the system as a whole. For example, binary 
component of the inspection system 6. defect detector 32 may "specialize in", or be constructed to 

Preferably, means are provided for displaying represen- be generally optimal for, detection of relatively large 

tations recorded by recording unit 66, such as representa- defects, without compromising the quality and efficiency of 

tions of individual defects, to an operator, thereby allowing detection of relatively smaU defects. Gray detector 64 may 

the operator to perform a variety of operator controlled 25 "specialize in", or be constructed to be optimal for, detection 

operations such as defect detection system diagnostics, of relatively small defects, without compromising the qual- 

defect verification and elimination, and defect classification. ity and efiSciency of detection of relatively large defects. 

Preferably, representations of a particular portion of a par- Another example of the "specialization" property is that 

ticular object may be displayed while the system is inspect- the scanning and subsequent processing provided by real 

ing a different portion of that object or even while the system 30 time defect detectors 32 and 64 may be carried out as rapidly 

is inspecting a different object. as desired, e.g. by decreasing the magnification at which the 

Diagnostic memory/processor 76 is operative to store inspected object is inspected. This need not substantially 

synthetic and real images corresponding to representations decrease the quality of detection since the post-processing 

of the inspected object. These representations may be gen- unit 67 specializes in accuracy at the expense of speed, 

erated from outside the system or by the real time recorder 35 Preferably, the post-processing unit 67 is operative to 

66. Diagnostics memory/processor 76 may also act as a test increase or decrease its accuracy in accordance with 

pattern generator, injecting test patterns into a selected decreased or increased accuracy at which the scanning is 

subsystem through test bus 78. being carried out. 

Under control of the main controller 8 each component of Reference is now made to FIGS. 2A-2F which concep- 
the inspection system 6 processes the input arriving from the 40 tually illustrate a preferred algorithm for the binary defect 
test bus 78 substantiaUy as though it were a real input from detector 32 of FIG. 1. The particular example illustrated in 
the image bus 72. The output from any such process may be FIGS. 2A-2F is that of a 3 pixelx3 pccel neighborhood, it 
recorded by the real time recorder 66 and analyzed by post being understood that this example is not intended to be 
processor 67. If desired, the output of the process may be limiting and is provided merely in order to facilitate under- 
displayed to the operator. The data transfeaed along the test 45 standing, 

bus 78 from diagnostics memory/processor 76 may com- FIG. 2A illustrates corresponding locations of the refer- 

prise a test pattern which has been specially generated for ence and of the inspected object, on the left and on the right 

diagnostic purposes. By examining the output of any of the of FIG. 2 A respectively. The two locations illustrated differ 

subsystems to the input from the bus 78 the operation of in that the middle pixel is shaded in the reference and not in 

each subsystem can be diagnosed and verified. 50 the inspected object. Such a difference may either be a 

In summary, diagnostic memory/processor 76 and buses genuine defect or a false alarm, due to any of a variety of 

72 and 78 provide the following capabilities: inaccuracies such as local misregistration and electrical 

A. Provision of "test" information to any component of the noise. FIG. 2B illustrates binary representations R and I of 
system and monitoring of the modifications performed on the above corresponding locations of the reference and the 
the "test" information as the "test" proceeds from that 55 inspected object, respectively. 

component of the system downstream. The binary defect detector 32 of FIG. 1 is operative to 

B. Comparison of a first representation of visual information detect differences between the binary representation of the 
received by a first component of the inspection system to reference and the inspected objects. Relatively small 
a second representation of that visual information output- detected defects are then preferably categorized as false 
ted by the first component of the inspection system or by 60 alarms and filtered out and "eroded", since very small 
any component of the inspection system downstream of genuine defects are substantially harmless in most applica- 
the first component. tions. The defects which remain after the filtering stage are 
A particular feature of the diagnostic process described reported as genuine defects. 

above is that the diagnosis takes place under conditions The operation of the binary defect detector 32, therefore, 

(timing, processing rate, control) substantially identical to 65 preferably comprises two sequential operations: 

those prevailing when the inspection system is operating in a. DIFF; identify differences; and 

an inspection mode. b. EROSION: erode false alarms. 
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These two operators are known in the art and are dis- 
cussed in detail in image processing texts such as "Digital 
Picture Processing" by A. Rosenfeld and A. Kak, Academic 
Press, 1982, the disclosure of which is incorporated herein 
by reference. 

An explanation of the operation of these two operators is 
now provided, with reference to FIGS. 2B-2E 

The DIFF operator, operating on a particular pair of 
corresponding binary pixels in the representations of the 
reference and inspected object, is defined as a function of R 
and of I. 

Sample formulae for DIFF are: 

DIFF-ifx(-/) or 
DIFF=/x(-/t) or 
DIFF=7?x(-/)+/(-/!), 

where x, + and - denote logical AND, OR and NOT 
operators, respectively. The first two DIFF operators are 
subtraction logical operators, and the third DIFF operator is 
a XOR logical operator. (-R) and (-1) are illustrated in FIG. 
2C. 

Results of the above three alternative DIFF operators are 
seen in FIGS. 2D, 2E and 2F, respectively. 

"False alarm" differences between binary representations 
may result from noise in the process of generating the 
representations. The amount of noise may vary as a function 
of the neighborhood of the current pixel. For example, the 
noise in the vicinity of comers is generally larger than the 
noise in the vicinity of straight edges. Therefore, the cut-off 
size differentiating genuine defects from false alarms is 
preferably controllable or selectable either automatically or 
by the user. Selectability of the cut-off size may be imple- 
mented by providing a plurality of EROSION operators, 
some combination of which may be selected either auto- 
matically or by the user. Selection is generally determined as 
a function of the geometry of the reticle and of a desired ratio 
between the genuine defects, and false alarms. Sample 
formulae for EROSION operators are: 

EAS^POxPlxP^xPSxPl A. 

£44-=P0xPlxP3 B. 

ESS'PQxPlxPZxPixPAxPSMxFJxPS C. 

ESA-PQxPlxPlxPS D. 

These formulae will be understood with reference to FIG. 
3A, which illustrates a binary pixel PO on which the ERO- 
SION operator is centered and the pixel's 5x5 
neighborhood, comprising pixels PI to P24 as shown. 

Formula A is a symmetric single step 4-connected opera- 
tor which erodes the entire perimeter of a binary shape, such 
as that illustrated in FIG. 3B, thereby reducing its thickness 
by two pixels, as shown in FIG. 3C. Formula B is an 
asymmetric single step 4-connected operator which erodes 
only two sides of the perimeter of a binary shape, thereby 
reducing its thickness by one pixel Formula C is a sym- 
metric single step 8-connected operator which erodes the 
entire perimeter of a binary shape. Formula D is an asym- 
metric single step 8-connected operator which erodes only 
two sides of the perimeter of a binary shape. 

Each of the single step operators A-D takes into account 
only those pixels which are directly adjacent to PO and 
therefore erode only one pixel from the relevant sides of the 
perimeter of the binary shape. Analogous operators which 
take into account two "layers" of pixels PO to P24 are termed 



)0,005 Bl 

18 

double step operators since they erode two pixels from 
relevant sides of the perimeter. 

A filtering method which may be used as an alternative to 
the EROSION operator method described above will now be 
5 described. 

In this method an "acceptance zone" is defined around the 
edges of the pattern of the reference. Differences which are 
completely contained within the acceptance zone are clas- 
sified as false alarms. Differences which fall at least partially 
outside the acceptance zone are classified as genuine defects. 
The operator which implements this method is termed the 
ACCEPTANCE operator. 

The acceptance zone comprises two subzones, the first 
"internal" subzone falling inside the binary shape and the 
second "external" subzone being disposed externally and 
adjacent to the binary shape. An internal acceptance subzone 
of size d comprises the set of pixels eroded from the binary 
shape by applying a single step EROSION operator d times. 

An external acceptance zone of size d is formed by the 
pixels added to the binary shape when a number d of single 
20 step DILATION operators are applied. DILATION operators 
are known in the art and are discussed in image processing 
texts such as Digital Picture Processing by A. Rosenfeld and 
A. Kak, Academic Press, 1982, the disclosure of which is 
incorporated by reference. Sample formulae for the DILA- 
25 TION operator, with reference to the notation introduced in 
FIG. 3 A, are: 

D4S~PQ^^PUFi+PS^P^ 1. 

30 The first formula represents a single step 4-connected 
DILATION operator whereas the second formula represents 
a single step 8-connected DILATION operator. 

The value d may be a constant related to the minimal size 
of defects or it may vary as a function of the patterns formed 

35 by the binary representations of the references. 

A preferred implementation of the "acceptance zone" 
method will now be described, with reference to FIGS. 
4A-4L The shaded portion of FIG. 4A illustrates the binary 
shape R of a portion of the reference. The shaded portion of 

40 FIG. 4B illustrates the area D of the reference defined by 
"adding*' R to an external acceptance subzone of R. The 
shaded portion E of FIG. 4C illustrates the external accep- 
tance subzone of R. The shaded portion of FIG. 4D illus- 
trates F, the area remaining after the erosion operation. The 

45 shaded portion of FIG. 4E illustrates the first, internal 
subzone G of R. 

The shaded portion of FIG. 4F illustrates the binary shape 
I of a portion of the inspected object corresponding to R. 
FIG. 4G illustrates the difference between the I shape and the 

50 R shape. The difference is operationalized as I-R and as R-I, 
as shown, FIGS. 4H and 41 illustrate the ACCEPTANCE 
operator. FIG. 4H shows the subtraction of external zone E 
from I-R resulting in a "false alarm" zone H and a "true 
defect" zone J. FIG, 41 shows the subtraction of internal 

55 zone G from R-I resulting in a "false alarm" zone K and a 
"tme defect" zone L. 

Reference is now made to FIG. 5 which illustrates the 
ultra fine level defect detection unit 64 of FIG. 1. 

The detection processes in both the inspected channel and 

60 the reference channel, and the process of comparing the two 
channels all employ full 8 bit gray level information. The 
processes are preferably based on multipixel operators 
called "triggers", described in greater detail hereinbelow, 
that are sensitive to specific variations in energy between a 

65 pixel and its surrounding pixels (energy gradients) and have 
the added important feature of being only triggered by small 
defects. 
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As shown, the ultra fine level defect detector 64 typically 6A. This operator is particularly useful in detecting hill or 

receives 8 bit gray level information representing the object valley defects of the types illustrated in FIGS. 6A. 6B and 
to be inspected from the scanner 10. Defect detector 64 also 

receives reference information via switch 65 comprising ii. a wide vertical operator, whose dimensions are typicaUy 

either aUgned bmao' rasterized information from databa^ 5 4x2 pixels, and which is shown by a heavy line in FIG. 

ahgnment memory 59, or ahgned gray mformation from die ^n.- * • 1 1 1 1 • j . u n 

alignment memo,^ 60. A switch 103 is provided for select- operator is parUcu arly useful m detectKig hUl or 

ing which of the aljove two types of informaUon is to be ^^Uey defects of the types lUustrated in FIGS. 6C and 6D. 

provided. Switch 103 is also operative to allow a diagnostic A narrow horizontal operator, whose dimensions are 

mode or an inspection mode to be selected. typically 1x4 pixels, and which is shown by a heavy line 

A smoothing unit 100 is preferably provided to convert ^° in FIG. 6E. This operator is particularly useful in detect- 

the binary information from database alignment memory 59 ing hill or valley defects of the types illustrated in FIGS, 

to 8 bit gray level information, thereby to enable its com- 6E, 6J and 6L. 

parison with the 8 bit gray level information representing the iv. A wide horizontal operator, whose dimensions are typi- 

inspected object. If the information arriving at smoothing cally 2x4 pixels, and which is shown by a heavy line in 

unit 100 is gray information from die alignment memory 60, 15 pjg gp jjjj^ operator is particularly useful in detecting 

switch 103 issues a suitable command to smoothing unit 100 hill or valley defects of the types illustrated in FIGS. 6D 

in order to prevent smoothing of the information. j^^j gp 

The gray level information representing the inspected ^ ^ forward slant diagonal operator, a typical con- 
object and reference resp^tively is provided via a switch figuration of which is shown by a heavy line in FIG. 6G. 
101 and smoothing unit 100 respectively, to defect sensing 20 ^hj^ particularly usefiil in detecting hiU or 
elements 102 and 104 respectively. Switch 101 is operative ^^^^^ „f iUustrated in FIGS. 6D and 6G. 
to allow a diagnostic mode or an inspection mode to be ^ backward slant diagonal operator, a typical 
selected In the first instance, the ^ay level information configuration of which is shown by a heavy line in FIG. 

.^^^ f ^^^'^T- P'r'^^'^ '^I 6H. This operator is particularly useful in detecting hill or 

bi« 78 (HG. 1). In the second instance, the gray level 25 vaUey defects of the types iUustrated in FIGS. 6D and6H. 

information provided to defect sensing element 102 is ^ ^^^^ ^^^^^ ^ ^ 

provided by scanner 10 (FIG 1). configuration of which is shown by a heavy line in FIG. 

Defect sensing elements 102 and 104 are preferably g, particularly useful in detecting hiU or 

subsUntiaUy identical and are based upon a plurality of ^^^^^ „f jj,^ m^jsimod in FIGS. 6D and 61. 

defect detection operators also caUed triggers, described in 30 ^ backward slant diagonal operator, a typical 

detail hereinbelow. configuration of which is shown by a heavy line in FIG. 

Defect sensing element 102 is operative to sense 6K. This operator is particularly useful in detecting hill or 

mspected object location representaUons which correspond j^j^^,^ iUustrated in FIGS. 6D, 6K and 
to putative defects in the mspected object. However, the 

triggers may ako react to some legitimate geometries. 35 / ^^^^^ ^^^j^^ j„ ^ 
thereby causing unwanted false alarms. In order to reduce j^^^, ^^^^^ ^^j^^jj ^ corresponding defect in 
these fake alarms, defect sensor 104 is provided which ^^ich each dark area is replaced with a light area and each 
applies the same tnggets to the reference mfonnation The jj^, ^^^^ ^ ^^^^ 
legitimate geometnes that prompt the trigger m the datas- ^ ^^^j^j j^^^ peripheral areas are defined for 
tream of the inspected object do the same in the reference 40 ^^^^ ^^^^ gjg^( operators described above. The respective 
Stream. , , . . central areas for each of the eight operators respectively 
Adefect comparison unit 106 compares triggers onginat- ^^^^ foUowing pixels, with reference to the grid 
mg m defect sensor 102 to tnggers ongmating in defect ^^^^ ^ row-defining letters and column- 
sensor 104 and m artificial defect sensor 112 (see below). ^^^^^ ^^^j^^ j„ ^^.^ g^, 6E, 6F, 6G, 6H. 61 and 
Typically, defect comparison unit 106 generates an output 45 resoectivelv* 
indication of each location of the inspected object which i B2 C2 
triggers defect sensor 102 and for which it is true that no ii Bl B2 CI C2 
trigger was gene rated by either defect sensor 104 or artificial q2 
defect sensor 112 in a window of predetermined size around iv Bl ' B2 CI C2 
the same location in the reference. A typical window size is 50 y Bl *B2 CI 'c2 
5x5 pixels. According to one embodiment, identified defects g2 ci C2 
are only discarded if the trigger generated by defect sensor ^ g2 ci 
104 and/or artificial defect sensor 112 indicates a putative ^j-j q2 

defect along the same direction having the sarne polarity ^j^, ^^^^ peripheral areas for each of the eight 

i.e both sensors identify the defect as a "hill or as a 55 ^^^^ respectively comprise the following pixels, with 

• vaUey ) and having a sunUar lUb value as the putative ^^^^^^^^ 

to the erid notation defined by the row-defining 

defect to be discarded. The terrn TOE ^ defined below. j^^^^^ column-defining numbers in FIGS. 6A, 6C, 6E. 

Reference IS now made to FIGS. 6A-6L which lUustratc gj gj^ respectively: 

a plurality of triggers which may be employed by defect 

sensors 102 and 104 of ultra fine level defect detector 64. 60 
Each trigger is superimposed onto a 4x4 pbcel neighborhood 

(A-D, 0-3), The shaded areas depict chrome-bearing or First Second 
opaque areas of the reticle. 



The plurality of defect sensing triggers comprises the I: ai A2 Di D2 

following triggers i-viii: 65 lii. co' C3 

i.Anarrow vertical operator, whose dimensions are typically iv. BO, CO B3, C3 

4x1 pixels, and which is shown by a heavy line in FIG. 
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-continued 





First 


Second 


V. 


A2, A3, B3 


CO, DO, Dl 


vi. 


AO, Al, BO 


C3, D2, D3 


vii. 


DO 


A3 


viii. 


AO 


D3 



For each operator, the sum of the energy levels of the 
central area pixels is denoted C. For example, for operator 
i, C=B2+C2. A weighted or unweighted sum of the energy 
levels of the pixels in the first periphery is denoted as PI. For 
example, for operator i, P1«A2. However, a preferred for- 
mula for operator V shown in FIG. 6G is the weighted sum: 
PloA2+2A3+B3. 

A weighted or unweighted sum of the energy levels of the 
pixels in the second periphery is denoted as P2. For example, 
for operator i, K=D2. However, a preferred formula for 
operator shown in FIG. 6G is the weighted sum: P2=C0+ 
2D0+D1. 

Defects are detected by comparing the sum of energy 
levels of the center pixels of an operator to the sum 
(weighted or simple) of energy levels of each of the periph- 
eries. If the sum of energy at the center deviates by more 
than a certain threshold value T from the sums of energies 
of the peripheries, a defect, residing in the central area, is 
identified. The use of a non-zero positive threshold value is 
preferable since it eliminates misidenlification of noise as a 
defect and also filters out very small defects. 

According to one preferred embodiment, the threshold 
value \ised in sensor 102 is slightly higher than the threshold 
value used in sensor 104. Consequently, substantially any 
putative defect which triggers sensor 102 will also trigger 
sensor 104, thereby reducing the false alarm rale. An addi- 
tional or alternative method for ensuring that substantially 
any non-defective location which triggers the inspected 
object channel wiU also trigger the reference channel is 
provision of the artificial defect detection channel described 
hereinbelow. 

According to a preferred embodiment, for operators i-iv, 
a hill or a valley defect is identified if the following 
conditions respectively hold: 

valley: C+r<2xPl 

and 

C+7<2xP2 
hill: C-T>lxP\ 

and 

C-T>2xPl 

It is noted that here, the peripheral sums are multiplied by 
2 since the peripheral areas are each half as large as the 
corresponding center area, and consequently are only com- 
parable therewith when the peripheral energy levels are 
doubled. 

For operators v-viii, a hill or a valley defect is identified 
if the following conditions respectively hold: 

valley: C+r<Fl 

and 

c+r<P2 

hill: C-T>Pl 
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and 

C-T>Pl 

A sample computation for operator iv disposed at pixels 
B0-B3 and C0-C3 of FIG. 6D, assuming the defect of FIG. 
6D has a gray value of 0 and an area of 0.5 pixel which is 
equally distributed over the four white (gray level«255) 
pixels Bl, B2, C2 and C3, is as follows: 

^0 j?l-52=C2-C3=yex255=approximately 225; 

C-900; 

2xPl=2(Al+51)-2(255+255)-1020; 
15 2xP2=2CA4+B4)=2(255+255)-1020. 

The size of the defect may be quantified, if desired, by 
defining a quantity designated as the Total Delta Energy 
(TDE). For each of the operators, the TDE is defined as the 

20 total energy of the central pixels minus the sum of the 
energies of both peripheries. By comparing the TDE to three 
different thresholds, detected defects may be classified as 
small, medium or large. 

A relatively large defect does not resuh in formation of a 

25 valley profile and the operator is not "triggered" thereby. 
Single edges also do not result in formation of valley or hill 
type profiles. A double edged profile also does not trigger the 
operator if the ratio of the size of the operator to the width 
of the profile is suflBciently small. 

30 In order to detect a defect disposed on the edge of, for 
example, a vertically disposed pattern, inspection along a 
vertical axis is preferable, whereas a defect disposed on the 
edge of a horizontally disposed pattem is most easily 
detected by inspection along a horizontal axis. Preferably, 

35 therefore, defect sensors 102 and 104 operate on each 
location to be inspected along a plurality of axes, such as 
four axes separated from one another by 45 degrees (termed 
the vertical axis, the horizontal axis, the 45 degree axis and 
the 135 degree axis). Therefore, each defect may be char- 

40 acterized as lying along a particular axis or axes. A defect 
may also be characterized as either a valley or excess 
chrome defect (such as a pin -dot as illustrated in FIGS. 6B 
and 6D) or a hill or deficient chrome defect (such as a 
pin-hole), depending on the shape of the detected energy 

45 profile. A generally point-symmetric defect, such as a pin 
hole or pin dot defect, will generally be detected along all 
detection axes. 

A defect sensing operator of one of the types i-viii 
described above may also be expected to be triggered by 

50 certain legitimate (non-defective) features of the inspected 
object representation operated upon. For example, a geom- 
etry such as a corner of less than 135 degrees may trigger the 
defect sensor. 

This situation is partially remedied by providing a refer- 
55 ence detection channel parallel to the inspected object 
detection channel and substantially identical thereto, as 
explained above. However, referring again to FIG. 5, it may 
sometimes occur that defect sensor 102 is triggered by a 
non-defective location in the representation of the inspected 
60 object but the identical (due to the non-defectiveness) loca- 
tion in the representation of the reference does not succeed 
in triggering defect sensor 104. This situation may occur 
even if defect sensors 102 and 104 are identically 
constructed, because the two sensors may not receive 
65 exactly the same input, due to the fact that the inputs thereto 
may not be identicaUy generated. For example, the input to 
sensor 102 of FIG. 5 may be generated by scanner 10, which 
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scans in 8 bit depth, whereas the input to sensor 104 of FIG. 
5 may be generated by converting binary database informa- 
tion to 8 bit level, v^so, even a "defectless" object to be 
inspected does not exactly correspond to its database 
precursor, because, inter alia, corners of the database pattern 
tend to be rounded as an artifact of the process whereby the 
inspected object is created. 

Consequently, a preferred remedy is to provide a refer- 
ence detection channel parallel to defect sensor 104 and 
comprising a feature detector 110 as well as an artificial 
defect sensor 112. The artificial defect detection channel 
may be designed on an ad-hoc basis to ensure that substan- 
tially any legitimate configuration which is misidentified by 
defect sensor 102 as a defect in the inspected object and 
which does not also trigger defect sensor 104, will cause a 
trigger along the artificial defect detection channel, thereby 
to allow the putative defect to be categorized as a false 
alarm. 

The feature detector 110 is also termed herein "the MIC 
feature detector", abbreviated as "FDM". The FDM is 
designed to recognize predefined geometric configiirations 
in the reference stream. The predefined configurations 
include those which generate a valid trigger in the inspected 
object but not in the reference. For those configurations, the 
FDM creates an artificial trigger that is added to the stream 
of triggers produced by the reference. 

Generally, the FDM performs a template matching opera- 
tion in which the templates are the predefined configurations 
and the search area is the stream of the reference. Since the 
size of the template is preferably large, such as 8x8 bits, a 
single look-up table may not be practical. Instead, several 
LUTs may be combined into a decision tree. The structure of 
the decision tree is based on the fact that the number of 
templates to be recognized is small with respect to the 
number of binary combinations of 8x8 bits. A preferred 
embodiment of feature detector 110 is described in Appen- 
dix 4. 

FIG. 7 is an intermediate level block diagram of smooth- 
ing unit 100, defect detectors 102 and 104 and defect 
comparison unit 106 of FIG. 5. 

As shown, smoothing unit 100 preferably comprises a 
binary-level to gray-level converter 114 and a convolving 
unit 116. Binary to gray converter 114 converts the database 
information which is provided in binary format at high 
resolution format into low resolution (such as 8 bit) gray 
level information, using any suitable method such as binary 
pixel counting. Convolver 116 further increases the number 
of shades of gray and provides spatial smoothing of the 
information by convolving the database information (DB) 
with a smoothing two-dimensional function, using a Gaus- 
sian or any other suitable function. 

A preferred implementation of such a function is a 5x5 
pixel template T such as 



r = 1/48XM 



1 
1 

where W = 1 
1 



The convolution is carried out by multiplying each pixel 
and its 5x5 surrounding neighborhood within the database 
by the template as follows: 

Surr{{DB)ijiT)tj]^j«l, . . . , 5 

Convolver 116 may also be a 6x6 convolver or may have 
any other suitable dimension. 
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Defect detector 102 comprises a plurality of defect detec- 
tion operator units, preferably eight defect detection opera- 
tor units 118, 119. 120, 121, 122, 123, 124 and 125 con- 
nected in parallel. The eight defect detection operator units 
may be based on the defect detection operators i-viii 
described hereinabove. Specifically, defect detection opera- 
tor units 118, 119, 120. 121, 122, 123, 124 and 125 corre- 
spond to operators iii, iv, i, ii, vii, v, viii and vi, respectively. 
Each defect detection operator unit is operative to span the 
stream of the input pixel to a required template and then 
mark "suspect" areas as triggers. 

Indications of horizontally oriented defects are provided 
by defect detection operator units 118 and 119 and are 
merged by a merging unit 130. Indications of vertically 
oriented defects are provided by defect detection operator 
units 120 and 121 and are merged by a merging unit 132. 
Indications of forward slanting diagonally oriented defects 
are provided by defect detection operator units 122 and 123 
and are merged by a merging unit 134. Indications of 
backward slanting diagonally oriented defects are provided 
by defect detection operator units 124 and 125 and are 
merged by a merging unit 136. 

As shown, defect detector 104 may be substantially 
identical to defect detector 102, apart from run time param- 
eters and for the parameters of the defect detection operator 
units. 

Defect comparison unit 106 typically comprises a plural- 
ity of channel handlers corresponding to a plurality of 
directions along which the defect inspection process takes 
place. In the shown embodiment, four channel handlers 140, 
142, 144 and 146 are provided which correspond to the 
horizontal, vertical, forward diagonal and backward diago- 
nal directions, respectively. 

The channel handler for each direction receives informa- 
tion about triggered reference locations from artificial defect 
sensor 112 as well as from the merging unit within defect 
detector 104 which relates to that direction. This information 
is compared with the information about triggered inspected 
object locations arriving from the merging unit within defect 
detector 102 which relates to that direction. After discarding 
putative defects which triggered both the inspected and 
reference channels, as explained above, the plurality of 
channel handlers provides the information about the remain- 
ing defects to a LUT 148. LUT 148 is operative to merge the 
information regarding defects detected along each of the 
plurality of directions, such as horizontal, vertical, forward 
diagonal and backward diagonal directions, LUT 148 may 
be based upon an OR logical function. The merged infor- 
mation provided by LUT 148 is received by defect processor 
62 of FIG, 1, 

Reference is now made to FIGS, 8A to 8H which are 
block diagrams of preferred embodiments of defect detec- 
tion operator units 118, 119, 120. 121, 122, 123, 124 and 125 
respectively. As stated above, each defect detection operator 
unit is operative to span the stream of the input pixel to a 
required template and then mark "suspect" areas as triggers. 
A coordinate system for the 8 templates of the 8 defect 
detection operator units 118, 119, 120, 121, 122, 123, 124 
and 125 was defined above with reference to FIGS. 6E, 6F, 
6 A, 6C, 6K, 6H, 61 and 6G respectively. The same coordi- 
nate system will be employed herein with reference to FIGS, 
8Ato 8H. 

Reference is now made particularly to FIG. 8 A which is 
a block diagram of the narrow horizontal defect detection 
operator unit 118 which operates on a spanned 1x4 template 
(CO, CI, C2, C3). An adder 150 computes the central area 
sum C, defined above with reference to RGS. 6A-6K, 
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which may be the sum of CI and C2. The sum of the 
energies of the peripheries, PI and P2, defined above with 
reference to FIGS. 6A-6K is computed by an adder 152. A 
subtracter 154 subtracts 2xC0, twice the first peripheral sum, 
from the central area sum C. A subtracter 156 subtracts 
2xC3, twice the second peripheral sum, from the central area 
sum C. LUTs 158 and 160 respectively compare the respec- 
tive outputs of subtracters 154 and 156 to respective pro- 
grammable threshold values. A subtracter 162 computes the 
TDE value, defined above with reference to FIGS. 6A-6K. 
The TDE value and the comparison results of LUTs 158 and 
160, via a logic unit 164, are received by a LUT 166 which 
provides an output indication of the defect/false alarm 
status, TDE level and polarity of the defect detected by the 
narrow horizontal trigger. 

The defect detection operator units of FIGS. 8B to 8H are 
constructed analogously to the defect detection operator unit 
of FIG. 8 A and therefore will not be discussed in detail for 
brevity. 

Reference is now made to FIG. 9 which is a block diagram 
of convolver 116 of FIG. 7. The convolver preferably 
comprises a 6x6 pixel spanner 170 connected to an array 172 
of 3x3 convolvers, typically comprising four convolving 
means 174, 176, 178 and 180. 

After the data resolution is reduced in unit 114 of FIG. 7, 
the data is spanned to a 6x6 window 184, illustrated in FIG. 
10. As seen in FIG. 10, the 6x6 window may be partitioned 
into four small 3x3 pixel arrays 186, 188, 190 and 192 which 
drive the convolving means 174, 176, 178 and 180 respec- 
tively. The outputs of the four convolver units are summed 
by an adder 182, thereby to provide an 8 bit gray level 
output. 

Reference is now made to FIG. 11 which is a block 
diagram of a preferred embodiment of channel handler 140 
of FIG. 7. Channel handlers 142, 144 and 146 may be 
identical to channel handler 140. 

As seen in FIG. 11, the channel handler 140 receives, in 
parallel, information regarding the reference from detectors 
104 and 112 of FIG. 5, and information regarding the 
inspected object from detector 102 of FIG. 5. The two 
channels of reference information are merged by an OR 
logical function. A spanning operation follows, resulting in 
a window typically having dimensions of 5x5. Finally, a 
parallel array 208 of trigger detector units, typically com- 
prising five trigger detector units 210, 212, 214, 216 and 
218, searches the window for valid "hill" and "valley" 
triggers. 

The inspected object information charmel, arriving firom 
detector 102 of FIG. 2, is directed via a selector 220 to a time 
equalizing unit 222 which is operative to delay the inspected 
object data by a fixed time interval. After the delay, the 
inspected object information is provided to a masking unit 
224. Simultaneously, masking unit 224 receives two chan- 
nels of data from each of the five trigger detector units 210, 
212, 214, 216 and 218. The two channels of daU are 
indicative of hill defects and valley defects respectively. 
Masking unit 224 masks or cancels out putative defects in 
the inspected object if a trigger, typically a trigger of the 
same polarity and having a similar TDE value, is contained 
within the 5x5 window corresponding to the putative defect, 
as explained above. 

In FIG. 11, "DL" indicates a unit which introduces a delay 
of one line and "R" indicates a unit which introduces a delay 
of one pixel. 

Reference is now made to FIG. 12 which is a block 
diagram of the real time defect recorder 66 of FIG. 1. As 
seen, unit 66 comprising a line buffer 226, m pixels in 
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length, which interfaces with a memory 228, such as a 
RAM, accessed by an x pointer 230 and a y pointer 232. 
Memory 228 typically comprises a IKxlK two-dimensional 
anray. 

5 The operation of the recording unit 66 is as follows: the 
line buffer 226 receives, during each line time, a represen- 
tation of a line of the inspected object or reference from 
input bus 72 (FIG. 1) via a serial input port 234. Each line 
is sequentially loaded via a parallel input port 236 onto the 

10 memory 228, at the y location pointed at by y pointer 232. 
Each time a line is loaded onto the memory 228, the y 
pointer is incremented. Therefore, the memory acts as a 
moving window storing a selected number of lines, such as 
IK, which are the most recently scanned lines of the object. 

35 When a defect occurs, the recording apparatus 66 is 
alerted to this occurrence by defect processor 62 (FIG. 1). 
The addresses of a neighborhood of pixels surrounding the 
defect are computed based on the coordinate signal arriving 
firom defect processor 62 which identifies the location of the 

20 defect. The portion of the contents of moving window 228 
identified by those addresses is random -access read, using 
X-Y addressing, by a control logic unit 238, and is supplied 
to postprocessor 67 (FIG. 1), A processing unit 240 is 
provided for initialization and testing. 

25 Upon receipt of a trigger and an indication of the location 
thereof, the recording unit 66 records a representation of a 
neighborhood of that location, typically 32x24 pixels in size, 
from image bus 72 (FIG. 1). The representation on image 
bus 72 may be the representation provided by any one of the 

30 components of the system interfacing with the image bus 72, 
as shown. Controller 8 (FIG. 1) is operative to determine 
which representations will be loaded onto image bus 72. 
These representations are then passed on through a tempo- 
rary memory 242 to postprocessor 67 of FIG. 1 where one 

35 or both of the following functions are performed: 

(a) determination of whether the putative defect is an 
actual defect or a false alarm; and 

(b) diagnosis of the performance of the subsystems of the 
inspection system which provide these representations, 

40 thereby enabling the operation of these elements to be 
modified in order to reduce the false alarm rate. 
Reference is now made to FIG. 13 which is a conceptual 
illustration of the postprocessor 67 of FIG. 1. 

The postprocessor 67 comprises a false alarm rate reduc- 

45 ing unit 250 which receives real time recorded representa- 
tions of a plurality of locations of the inspected object from 
the real lime defect recorder 66 of FIG, 1, as well as the 
coordinates of each of the plurality of locations. The false 
alarm rate reducing unit 250 also receives reference infor- 

50 mation. The reference information may comprise binary 
database information pertaining to defect locations as iden- 
tified by the defect coordinates and provided by database 
rasterizer 56 (FIG. 1), in the case of die to database com- 
parisons. Alternatively, if a die to die comparison method is 

55 employed, the reference information may comprise gray 
reference information pertaining to the locations of the 
reference object corresponding to the locations identified by 
the defect coordinates. 

False alarm rate reducing unit 250 reanalyzes each puta- 

60 tive defect location, fillers out false alarms and provides an 
output indication of the coordinates indicating the locations 
of true defects which is stored in a defect memory 252. False 
alarm reducing unit 250 also preferably categorizes the 
defects according to at least some of the following criteria: 

65 missing/extra chrome, edge/isolated/coraer defect, size, l^e 
information regarding the location and categorization of the 
defects as identified by false alanm reducing unit 250 is 



06/28/2004, EAST Version: 1.4.1 



us 6,360,005 Bl 



27 



28 



Stored in a defect memory 252. Preferably, the stored infor- 
mation is analyzed statistically by a statistical analysis unit 
254 which may comprise any suitable statistical software 
package such as SAS. 

Preferably, an operator display 256 such as a CRT pro- 
vides an on-line display for the operator of the defect 
analysis process. The display preferably comprises a display 
of the defect images analyzed by the false alarm reducing 
unit 250. 

The on-line display 256 enables the operator to review the 
defect images and, via a defect classification unit 258, to 
amend defect classifications. Preferably, the user may also 
indicate to the system that a particular putative defect 
designated by false alarm reducing unit 250 is a false alarm. 
Defect memory 252 may interface with a repair machine 
(not shown) such as a repair machine manufactured by 
Quantronix, Smithtown, N.Y., USA, to repair the reticle. 

The defect post-processing uinit 67 is preferably imple- 
mented in software as opposed to the defect processing units 
32 and 64 of FIG. 1 which are implemented in hardware. 

A preferred method for reducing the false alarm rate and 
classifying defects is as follows: 

The real time recorder 66 (FIG. 1) records the sampled 
gray image of the area around and including each putative 
defect pixel in the inspected object together with the relevant 
coordinates. The putative defect pixels are defined as those 
defects reported by defect detectors 32 and 64 of FIG. 1. 

The first step in false alarm rate reduction is arrangement 
of the putative defect data and may comprise the following 
substeps: 

clustering the data into groups of adjacently disposed or 
"connected" putative defect pixels; 

for each cluster, constructing an "inspected putative 
defect image" which is a unified image of the inspected 
object in the vicinity of the current cluster of putative 
defect pixels; and 

extracting from the stored database a "corresponding 
reference image" which is that portion of the database 
corresponding to the inspected putative defect image. 

A preferred false alarm rate reduction method may com- 
prise the following steps: 

1. Binarization of the inspected image and of the reference, 
if the reference is not represented in binary form, as 
explained above. This may be implemented using algo- 
rithms described in U.S. patent application Ser. No, 
684^83 the disclosure of which is incorporated herein by 
reference. Preferably, the algorithms are software imple- 
mented. 

2. Global matching of the binary representations of the 
inspected and reference images. The matching is global in 
the sense that the complete recorded area is taken into 
account. A preferred global matching technique is tem- 
plate matching in which the template is the inspected 
putative defect image, the search window is the reference 
image, and the match criteria is the minimum of the area 
of the XOR of the inspected putative defect image and the 
corresponding portion of the reference. 

In order to decrease the computation load, the matching 
process is repeated more than once. The first repetition is 
performed on the two images at a relatively small resolution, 
such as a resolution reduced, relative to the original 
resolution, by a factor of between 2 to 8. In the first 
repetition, the search window is relatively large. Subsequent 
repetitions are performed on the two images at increasing 
resolutions until the original resolution is restored. In the 
subsequent repetitions, the size of the search window is 
gradually decreased. Matching techniques are described in 



Digital Picture Processing by A. Rose nf eld and A. Kak, 
Academic Press, 1982, Vol. 2, Sections 9.4 and 12.1. 

3. Local matching of the binary representations of the 
inspected and reference putative images. This matching is 

5 local in the sense that only the subimage contained in the 
enclosing rectangle of the putative defect pixels is taken 
into account. This step may be implemented by the 
template matching step referred to hereinabove, however 
the template area is now the enclosing rectangle area and 

10 the resolution is the original binary resolution. 

4. Computing a difference measure which may comprise one 
or both of: 

(a) the area of the XOR between the inspected and 
reference image portions after the local matching; and 
15 (b) the width of the XOR between the inspected and 
reference image portions after the local matching. The 
width measurement may be operationalized as an indi- 
cation of whether the width does or does not exceed a 
certain threshold. This indication may be implemented 
20 by eroding a predetermined number of pixel layers. The 
predetermined number may be a function of the desired 
false alarm rate and of a predetermined threshold 
determining the minimum size of putative defect which 
is to be categorized as a genuine defect. 
25 5. Classification of the matched images, thereby to provide 
an inventory of the area, size and type of defects. 
Reference is now made to FIG. 14 which is a combined 
block diagram and schematic front view of a preferred 
embodiment of the scanner 10 of FIG. 1, constructed and 
30 operative according to a preferred embodiment of the 
present invention. 

The scanner 10 comprises a bi-axis positioning subsystem 
denoted 302, lower and upper illuminating subsystems 304 
and 305 respectively, and an image acquisitioning sub- 
35 system 306. The structure and the operation of each sub- 
system will now be described separately. 

The bi-axis positioning subsystem 302 may be a Micro- 
glide L250 commercially available from Anorad Co., 
Haupauge, N.Y., USA and comprises a granite table 30& 
40 having a bore 309 and a moving stage 310 provided with 
linear motors (not shown), air bearings (not shown) and a 
laser interferometer 314. The position of the stage 310 as 
measured by the interferometer 314 is transmitted to a stage 
controller 312. 

45 Supported above the stage 310 is a bi-axis positionable 
and rotatable holder 316 for holding the to-be-inspected 
reticle. The position and orientation of the holder 316 are 
controlled by a motor controller 318 via motors (not shown). 
The reticle is illuminated by the lower illuminating sub- 

50 system 304 which is situated beneath the granite table 308 
and which is described in detail with reference to FIG. 15. 
The apertures and filters of the subsystem 304 are motor 
driven under the control of motor controller 318. 

The illuminated reticle is viewed by a microscope 320. 

55 The microscope 320 is preferably provided with a plurality 
of objective lenses with different magnifications, preferably 
standard magnifications. The magnified image of the reticle 
generated by the microscope 320 is acquisitioned by the 
CCD line array sensor of a camera unit 322. The reticle is 

60 maintained in focus by means of an autofocus assembly 324 
which is controlled by a focus control unit 326. The selected 
objective is positioned with respect to the optical axis of 
microscope motor means (not shown) driven by the motor 
controller 318. 

65 The timing and amphfying operations of the camera unit 
322 are controlled by a camera controller 328. Trigger 
signals for camera controller 328 are generated by a vision 
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unit 330 in response to signals received from a stage 
controller 312 which describe the coordinates of the stage 
310. 

The camera controller 328 transmits a digital video signal 
of raw 8 bit gray data to the vision unit 330. The vision unit 
330 then processes this data to compensate for the non- 
uniformity of the response of the CCD sensor and provides 
an output of the processed final gray data to units 30 and 22 
of FIG. 1. 

Interposed between the microscope 320 and the camera 
322 is an extension tube 332. The extension tube 332 relays 
the image generated by the microscope 320 to a trinocular 
334 and to a color camera 336 for displaying the image on 
a color display 338. 

The activities of the stage controller 312, the motor 
controller 318, the focus control 326 and the camera control 
328 are controlled by a CPU 340 in accordance with control 
data sent to the scanner 10 by the main controller 8 of FIG. 
1. 

Reference is now made to FIG. 15, which is an exploded 
view of the optical components of the scanner 10 of FIG. 1. 

The illuminating subsystem 304 preferably comprises a 
lamp housing 342 accommodating a lamp such as a high 
pressure mercury arc lamp and a collimating lens 344 having 
a high numerical aperture, preferably exceeding 0.5. The 
light beam emitted from the lamp is reflected by means of 
two "cold mirrors" 346 and 348 which filter out IR radiation 
and also provide the degree of freedom required to align the 
light beam along the optical axis of the optical system above 
the mirrors 346 and 348. 

After the light beam deflects from mirror 348, focusing 
lens 350 generates a magnified image of the arc lamp on the 
lower surface of a cladrod 352, comprising a long, wide 
optical fiber. Cladrod 352 is configured and arranged such 
that the illumination on its upper surface remains uniform 
over the widest possible field of view required by the 
system, when the system requires the solidest possible angle 
for the highest numerical aperture, and for reticles of dif- 
ferent thicknesses. 

Preferred values for the diameter of the uniform illumi- 
nation and for the numerical aperture are 2.8 mm and 0.55 
respectively. These values allow reticles 354 of different 
thicknesses to be illuminated without employing compen- 
sating lenses and without moving any optical element. 

The upper surface of the cladrod 352 is imaged by a lens 
assembly, generally denoted 355, comprising lenses 356, 
358, 360 and 362. Lenses 356 and 358 control illuminated 
field width by generating an intermediate image of the upper 
surface of the cladrod 352 in the plane of the field aperture 
364. Lens 356 collects the light from the cladrod 352. Lens 
358 is a field lens which enables all the light to be collected 
from the upper surface of the cladrod 352 without "vignett- 
ing". 

Ijenses 360 and 362 image the intermediate image and the 
field aperture 364 on the upper surface of the reticle 354. 
Lens 360 operates as a field lens for lens 362 which is the 
condensing lens of the illuminating system 304. Condenser 
aperture 366 below the condenser lens 362 adjusts the 
numerical aperture of the condenser 360 to the particular 
requirements of the different system operating modes. 
Lenses 356 and 362 may be condenser lenses. Lenses 358 
and 360 may be field lenses. 

The lens assembly 355 preferably has no critical optical 
surfaces imaged on the reticle 354. The length of lens 
assembly 355 is sulEcient to "transfer" the image of the 
cladrod upper surface through table 308 and moving stage 
310 to the reticle. 
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The diameters of the field aperture 364 and the condenser 
aperture 366 are adjusted by gears 368 and 370, respectively, 
driven by motors 372 and 374, respectively. The motors 372 
and 374 are controlled by the motor controlling unit 318 

5 (FIG. 14) and are preferably situated below the granite table. 
The illimaination level for a particular operating mode of 
the inspection system 6 is achieved by use of a continuously 
varying ND filter wheel. As is well known in the art the 
transmission of such filters alters as a function of the 

10 rotational angle thereof. The actual illumination level 
present in the system is detected by the camera 322 which 
enables any deterioration in light generation by the arc light 
to be compensated for. By calibrating the light level detected 
by the camera 322 as a function of the angular position of 

15 ND filter 376 for each of the operating modes, CPU unit 340 
can control the illumination level within the system via 
motor control unit 318. The ND filter 376 may be rotated by 
any suitable means such as motor and gear arrangement (not 
shown). 

20 A metal plate 378 is provided above a portion of ND filter 
376. Plate 378 is operative to block out the lower illumi- 
nating system when the scanner is in an "upper illuminating 
mode" or for the "dark level" calibration of the camera 322, 
The metal plate 378 and the ND filter wheel 376 are rotated 

25 by the same motor and controller 

A fiber optics light guide 380 is provided alongside lens 
356 and aligned towards the upper surface of the cladrod 352 
thereby enabling changes in the arc intensity to be detected 
and measured. The position of the light guide 380 minimizes 

30 changes as a result of arc movements. 

The guide 380 samples the light emitted from the cladrod 
352 and transmits the sample to a light detector 382. The 
electrical signals from the detector 382 are sent to the 
camera control unit 328 which measures and compensates 

35 for changes in arc intensity. 

The microscope 320 is preferably of the "infinity cor- 
rected" type, and generates an enlarged image of the reticle 
354 on a plane disposed approximately 103 mm thereabove. 
The microscope 320 primarily comprises three objectives 

40 384 mounted on a rotatable objective wheel 386 and a 
telescope lens 388 such as that forming part of a "Leitz" 
Modulo-pack LAP unit 390. 

The modulo-pack unit 390 further comprises an automatic 
focus sensor 392 for sensing the focussing error of the 

45 objective in the optical path of the microscope relative to the 
upper surface of the reticle 354. The error signal from the 
sensor 392 is sent to the focus controller 326 (FIG. 14) 
which, in turn, transmits a correcting signal to a focusing 
motor 394. The rotational movement of the motor 394 is 

50 converted to a vertical movement of the objective wheel 386 
by means of a gear and slider arrangement 396 until a null 
signal is detected by the focus controller 326. 

Different heights of various reticles 354 and of the objec- 
tive lenses 384 can be accommodated for by altering the 

55 reference plane of the focus sensor 392. This is achieved by 
means of a focus off-set unit (not shown) incorporated 
within the Modulo-pack unit 390 which sets the height of the 
reference plane by a gear and motor 398 under the control 
of the motor controller 318 (FIG,- 14). The image of the 

60 reticle that is generated by the microscope 320 may suffer 
firom residual aberrations such as lateral color, astigmatism 
and curvature of the field. An optical subassembly 401 may 
be employed to obtain a diffraction limited image over a 
field as large as CCD sensor 400 which may comprise a 

65 1024 element line array, llie subassembly 401 typically 
comprises an eyepiece 404 and a doublet relay lens 406. The 
CCD sensor 400 is set on a fixture 407 having 3 translational 
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and 2 rotational degrees of freedom for aligning the sensor 
400 to the optical axis of the system. 

For verification of the results of the reticle tests, an 
extension tube assembly 332 (see FIG. 14) is used to convey 
the image of the reticle to the trinocular unit 334 and the 
color TV camera 336. The extension tube 332 comprises a 
prism wheel 408, a cross reticle 410, a lens 312, and a beam 
splitter 414. Beam splitter 414 directs a portion of the beam 
to trinocular unit 334, via a lens 416 and a mirror 417. Beam 
splitter 414 directs another portion of the beam to the camera 
336, via lens 420 and mirrors 418 and 422. 

The prism wheel 408 is provided with an aperture 424 for 
straight line passage of the image to-the CCD sensor. 400 in 
a reticle scanning mode and carries two prisms 426 and 428 
for reflecting the image to trinocular unit 334 and camera 
336 for a reticle verification mode. The wheel 408 is rotated 
by motor 402. 

A prism 426 is used when the reticle is illuminated by the 
lower (transmitted light) illuminating system 304. A prism 
428 replaces prism 426 when the reticle is illuminated by a 
upper (incident light) illuminating subsystem 305. The dif- 
ference between the prisms 426 and 428 is that the prism 426 
is coated to block out UV radiation and to attenuate the 
visible light to a safe level. 

The upper illuminating system 305 may employ a tung- 
sten halogen lamp 425, preferably located under the granite 
table 308. The light is transmitted by a fiber optic light guide 
426. When the reticle is illuminated by incident light, the 
scanner 10 is said to be in an "upper illumination mode" and 
all transmitted light from lamp 342 is blocked by rotating the 
filter wheel 376 and the blocking plate 378. To verify that the 
light from the lower illuminating system 304 is blocked, a 
pair of detectors 429 is provided in the camera opening of 
the trinocular 334. The output of detectors 429 is received by 
a control unit (not shown). If a signal above a safety 
threshold value is detected, the coated safety protecting 
prism is rotated into the optical path. 

The terms "inspected object", "object to be inspected" 
and "patterned object" as employed in the present specifi- 
cation and claims are intended to include substantially any 
object such as but not limited to the following elements: flat 
panel displays, reticles, printed circuit boards, semiconduc- 
tor wafers and photomasks. 

The above terms are not intended to exclude objects 
whose surface has a continuous appearance such as blanks 
of any of the above elements. 

It will be appreciated by persons skilled in the art that the 
present invention is not limited to what has been particularly 
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shown and described hereinabove. Rather, the scope of the 
present invention is defined only by the claims that follow: 
We claim: 

1. A system for inspection of a substrate, comprising: 
5 a scanner for scanning the substrate and providing a gray 
scale inspection signal; 
a reference database having a binary reference signal 

stored therein; 
a binarizer operable to binarize the gray scale inspection 
"^^ signal into a binary inspection signal; 

a binary to gray converter operable to convert the binary 

reference signal into a gray scale reference signal; 
a misalignment detection system operable to detect mis- 
alignment between the binary inspection and reference 
signals, and gray scale inspection and reference signals; 
a first defect detector operable to compare the binary 
inspection signal to the binary reference signal to detect 
substrate defects in a first range of sizes; and 
20 a second defect detector operable to separately compare 
the gray scale inspection signal to the gray scale 
reference signal to detect substrate defects in a second, 
different range of sizes, and including defects smaller 
than those detected by said first defect detector. 
25 2. The inspection system of claim 1, further comprising a 
masker operable to mask selected data. 

3. The inspection system of claim 1, further comprising a 
defect classifier. 

4. The inspection system of claim 1, wherein said binary 
30 inspection signal is of higher resolution than the gray scale 

inspection signal. 

5. The inspection system of claim 1, further comprising 
an inspection alignment memory for storing said gray 

scale inspection signal; and 
35 a reference alignment memory for storing said gray scale 
reference signal. 

6. The inspection system of claim 5, wherein said mis- 
alignment detection system detects misalignment between 
said gray scale inspection signal and said gray scale refer- 

40 ence signal using said inspection alignment memory and 
said reference alignment memory. 

7. The inspection system of claim 1, further comprising a 
feature detector for detecting and marking problematic fea- 
tures in said binary reference signal. 

45 8. The inspection system of claim 1, wherein said second 
range overlaps said first range. 

* 4t * * * 
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